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A longitudinal study was conducted to evaluate the 
U.S, .Employment Service*s Specific Aptitude: Test Batt&ry (SATB) for 
plumber/pipe, fitter from % three aspects: technical adequacy of the 
research; fairness to minorities; and usefulness in the selection ot 
individuals for training as plumber/pipe fitter apprentices. The 
validation safeple consisted of 253 apprentice^ (including sixty-nine 
jinojrity group members) in their f irs^t year <of apprenticeship during 
197*1-1976 in eight- states ,and the District - of* Columbia , The tests, for 
this sample were taken-. from the General Aptitude test Battery, while 
on-the-job competency was gauged by supervisors 1 ratings, and ability 
to' perform fiite categories of related course work was measured by- 
instructors' ratings/ A cr'oss-validation sample was -also used, based 
on data collected in 1.53-1954 from 322 apprentices in Texas (the 
minority ^group composition of which was' unknown).* Criterion for this 
group consisted of category ratings for .a combination of job 
performance and school achievement. SATB was found (1)* to be c useful * 
in th$ selection of .apprentices; (2) to be fair to minorities; and 
(3) to £eet all criteria for" validity using the more fcecent sample 
and for" cross-validity based on thevPrior test sample* (The 
appendixes include the following: statistics for black and 
aonminority subgroups of the validation sample; descriptive rating- 
scales fqr employers and instructors; and a job 'description and the 
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GA.TB Study No, 3031 



• DEVELOPMENT OF USES SPECIFIC APTITUDE TEST BATTERY S-61R78 
' * * for ' . 

■ PLUMBER^Cconst.) §62.'381-030.\ 

■ . ' ' . PIPE FITTER {const..) 862.381 -Oltf\ 

• * , • SUMMARY ' ' • 

This import is designed to provide the information required to evaluate the 
Specific Aptitude Test Battery (SATB) for Plumber/Pipe Fitter from three points 
of view: J (1) technical adequacy of the research; (2) fairness 'to minorities; 
and (3) usefulness of the battery to Employment service staff, apprentice 
selection committees*, and employers in selecting HMiViduals for trailing as 
Plumbers/Kpe Fitters, 

Research demonstrated a statistically significant usefbl relationship, 
between .prof ici^ncy as Plumfter/Pipe Fitter Apprentice and the following 
Specific Aptitude Test Bavtery: 

^ * Aptitudes * Cutting Scores* . 

\ Vy Verbal Aptitude * '* 90 * * - 

P*- Form Perception 95i , • - 

M - Manual Dexterity , - 85 j 

_y * ^ * 

The validation sample for this SATB consists of 253 'Plumjber/Pipe Fitter appren- 
tices (including 46 Blacks), Selection was through the tfnitfed Association of 
Journeymen and Apprentices of th£ Plumbing and Pipe Fitting Industry of the ILS, 
and Canada and the National Joint Plumbing Apprentice and Journeymen Training - 
'Committee- Selection was limited tc individuals in. their first year of*appren- 
ticeship training, Data were collected from 8 States and the District of 
Columbia during 1974-1976/ . Tfte .tests used were those of the General 
Aptitt&ie Test Batteiy (GATB)\ On-the-job proficiency of app?fenti<fes working, 
in the Plumber/Pipe Fitter construction industry was gauged by supervisors \ 
ratings; ability to perform related course work was determined by instructors* 
ratings of five major* categories of course work, * v 

A seeonft "sample corj^*n5ed or cross- validated the SATB. This sample consisted 1 of 
322 aijprenticed Plumbers and Pipe Fitters. The criterion consisted of bipad 
category* ratings based on a combination of joty performance and school achieve- 
ment, These ratings were made by the Area Joint QStomittee *of Plunders and Pipe 
Fitters and school coordinators. The data were collected in 19$$-$A* Hie SATtf 
did riot "cross -validate with data collected in 1953^54 on a Texas sample of 89 
journeymen Plumbers and Pipe Fitters. 

No evidence of ,dif^erei*ces % in validity for Blacks and nohninoritigs' was found; * 
the SaTB wis found to be fair to Blacks and nonminorities using several defini- 
tions of fairness, Additional information may be found in the Validity of the 
Battery section and in Appendix 1, 



This SATB better meeta standard^'fdr an 'acceptable pre^mployment test than " \ 
priorSATB's, The original SAFE- (B-304) was found to bV valid for the totfcl \ ' 
validation sample anql the nonminority subgroup but not for the Black subgroup* 
The S-6iR battery, developed in 197G, cross*valid^fted with the total validation * 
sample but net with the nonminprity and Black subgroups. ' m 1 

S-61R78 can ba expected to produce a useful increase in the proportion of ■ 
highly proficient workers. When the SATB wa§ applied to the validation sample, 
composed of first year apprentices, an increase ficm 67$ to 801 in the propor- , 
' tion of -highly .proficient apprentices was founJt Similar, results were found 
"for the 'Cross -validation sgmple, — 

' \ , > ^ » - ' PROCEDURE. " : 

A' longitudinal Resign *was used for the Validation study; GATE te§t data were 
.collected f*om apprenticeship applicants as soon, as they were accepted for the 
program, Job r performgnce criteripn data were not collected until subjects h^d 
completed at least one year or chopped out of the program. Instructors' ratings 
were obtained for each member's pferformance* in each of six curriculum areas - 
"periodically while the training was in progress. Local, Joint Apprenticeship 
'and Training Camiittee (JATC) representatives and State agency test research 
analysts .collected these data from March 1975 to September 4976. 

* ■ \ ♦ 

, Job Analysis - ' - . * 

A current job description for Plumber/Pipe Fitter was provided to all participat- 
ing Stages/ JATC's and the, apprentices' supervisors wfere consulted to ascertain 
that all apprentice! were* doing the same work* The job description "shown in 
Appendix 4, is the result of this action and may bemused t© provide Unfoimatityr 
on the applicability of thfe test battery resulting from this research* ^ 

Each job duty was rated for frequency of perfomance, toetjtentage of time spent, ^ 
and leveL of difficulty as - part of the job .analysis/ Critical" job duties were * 
identified on the basis of these Ratings. 

At least one anal/st at each location rated the aptitudes as irrelevant, ijnpop* 
tant,*or critical to performance of the job duties at that location, ^synthesis 
of these ratings and their ratioj\al& follows: , \ 1 

G - General Learning ^Ability Required to interpret blueprints, job specif i- 

r * cations, and building codes; to comprehend safety 

codes; to plan and coordinate work with other 
; ^ / - * crafts;' to learn properties of a variety tff * 

**\ ' /, * ; \^ ' metal 'and nonmetal pipes and methods of joining, > 

,' t \ threading and bending- these pipes,- - ' 

N - Numerical Aptitude * Required to estimate quantities of material 
v . ♦ needed; to determine length and size of pipe; 

to measure placement: of pipes* 'drains, controls 
- * . and fixtures* , ' a 

S - Spatial Aptitude/ Required to visualize three-dimensional instal- 

' ' i lations from blueprints, specifications and 

instructions* \ \ 
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P - Form >erception , # . Required*to recognize fittings /pipe sizes, 

fipols and materials; and to recognize and 
f ' interpret symbols on blueprints and specifi- 

, * cations* 

M - Manual dexterity - Required to use hands and wrists in placing 

+ ' * arid turning motions to use h^nd, power and 

power -actuated tools to cut, beijd, fabricate 
and install pipe systems, 

jerimeqtal Test B attery f 
st V 



experimental test battery for the validation sample consisted of all 12 tests 
o£-the GATB, B-IOO^B* All parts of Form B-1001 were administered to the cross- 
validation* sample, .B-1001 scores wjere converted to equivalent B-1002 scores, 
• Information on the composition bnd developigental research of the GATE may be 
fbund*inthe Manual fgr the General Aptitude Test Battery , Sectiohlll, Develop- 
ment, availably from the Government Printing ptfice, ] / 

Validation Sample Description * * 

Tt\e valid^ion sample consisted of 253 Plumber /Pipe Fitter apprentices employed \ 
at various locations in the North, South, and West (see ACK^K)WLEI^G^1ENT)^ *A total , 
of 69 were minority group members (46 s 61acks, 16 Spanish Surnamed, 4jVmerican 
Indians, 1 Oriental, and £ French Oanaiftfans) and 184 were nonmiriority group v 
members* 'All of the 253 subjects Vere male, The-means and standard deviations * 
for age and - education of sample^ members are shown in Table 1, 

All subjects except dropputs4iad been in the Plumber/Pipe Fitter apprenticeship " 
pipgrdta format least a year. No rampl^foembers were test-selected* To have 
been accepted into the program, applicants had to be 16 years old and have- 
graduated from high school or passed the GED hi h school equivalency tests. 

Descriptive statistics for Black and nonminbritv subgroups are shown in Appendix L 

Gross -validation Sample Description ' * 

The cross-validation saiifple was obtained in 1953-54 prior to the requirements of 
providing minority group information, 1 Therefore, elJiriitx^roup t composition is 
unknown. The sample consisted of 322 male workers a^rertraxzed gs PlGmbers and 
Pipe Fitters in various cities in Texas, * The means and stamArd deviations of J* 
age/ education and experience of sample members are shown Hji|^aBle la, * * 

Criteria for Validation Stydy ( * 

The criteria for the validation stqdy consisted of combined supervisory ratings 
,and the sum of instructors* ratings on 5 d£ the 6 curriculum courses/ instruc- 
tors* .ratings for Course A—Safety wer,e not used because o4p incbjnplete data, 
t Test scores were also cpllected for 15 tests covering subject, matter included in 
1 the 6 standard curriculum courses of related apprenticeship training,* These 
test scores were not used as a criterion because most apprentices achieved an 
overall score of satisfactory for thesis tests, - 



Supervisory ratings were obtained by mean< of personal visits of JATC coordina- 
tors who "explained the rating ^rocedui^ % to the supervisor* Each subject was 



rated'twice by a first line supervisor with ^intferval of two weeks between 
ratings, or once e?ch by /a first line and a second lita* supervisor. Since / 
sample jnembers\ aptitude scores are cortf idefltial , supervisors had no knowledge 



of apprentices 1 aptitude test scores.-* Thus, ^the possibility of the^e scores 
affeeting ratings did not exist. . " « / 
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A descriptive rating scale was used. The scale (see Appendix 2) consists of ?ix 
items, five of these items cover different aspects of job performance, The 
sixth is 'a global *item on the Plumber/Pipe" Fitter's n all-ajound" ability, Each 
item has five alternative responses Corresponding to different degrees of Job 
proficiency, For the purppse of -scoring items, weights of 1 to 5 were'assigned 
to the responses, The total score on the [pat ing seal** is the sum of the weights 
for the six items, The possible range for eacji rating is 6-30 or 12-60 for 
combined ratings, , ^ 

A review of the job description indicated that the items covered by the mating 
scale were direetly related to important, aspects of job duties performed by 
Lumbers/Pipe' Fitters, * * 

* ■ . 

A * Quantity of work: A Plumber/Pipe Fitter must' work, rapidly and efficiently 

■in order to meet standards of accomplishment set for competitive contract 

work. . ^ 

-B - Quality of work: A Plumber/Pipe Fitter's work must be ofhigh quality to 
tneet job specifications, local building fcodes and safety requirements as 
determined by the Occupational Safety Act of 1970 J 

C * Accuracy of work: A Plumber/Pipe Fitter must install all, piping systems 
according to' government requirements, local codes and jbb specifications 
, based on a study of building plans and working drawings, , . ^ 

D - Job knowledge: A Plumber/Pipe Fitter must have knowledge of materials used 
to install or repair systems* for power generating facilities, heating, 
refrigeration, water supply, ^torm drainage, sanitary and industrial 1 
facilities, 

E - Job yersatility: A- Plumber/Pipe Fitter must be capable of performing a 

yide variety of installing and repairing tasld with a w|de variety of 
^y"mate rials under widely varying conditions, 

* *• ^ ^ 

F - ''All-around" job ability; A Plumber/Pipe Fitter's value involves a cfiribi- 
nation of aspects of job ^performance listed above, * * * 

A reliability coefficient of .56 was obtained between the two different super- 
' visory ratings, Although this figure is considerably ^ower than that obtained 
i for most S/ studies, the reliability of the conibiiiation of the two supervisor 

ratings is e~ imated by the Spearman-Brown foxmila to be ,72, Therefore; the 
, final job performance criterion score consists of the combined scores of the* ^ 
two ratings, Th6 possible rapge for the combined scores is 12-60- The actual- 
range for the total sample is 18-58. The mean is 39,7 with a standard deviation 
of 6,3, The relationship between the job performance criterion and age and^ 
education is shown in Table 1, / - 

Instructors* ratings were obtained fr*n instructors who taught the various curric- 
ulum courses. Each apprentice was rated once^by tte instructor for each of the 
five training courses. Courses B and C are related the6ry courses, aijd Courses 
D-F are related practical or manipulative courses (see Appendix 5), Instructors "* 
. had no knowledge of apprentices' aptitude test scoresy and so these scores had no 
effect on curriculum course ratings. 

A descriptive rating scale for apprentices was used to obtain instructors' 
ratings, The scale (see Appendix 3) consists of six items, Five of these items . 

* ■ * 
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cover different aspects of trainijig.^The sixth is a global item on "all-around" 
training ability, Each ±t§frft£$ five alternative responses corresponding to 
different degrees of^trdlJiing proficiency, Scoring weights of^l j:o S were 
assigned to-tiigse^fesponses. The total score on the rating scale is the sum of 
the weights fey the six items, " Possible ranges for instructors' ratings are 6-30 
. Iforjg^tf^course rating and*3p-150 for combined ratings (Courses B-F) , ". 

^A^review.of the course outline for Plumber/Pipe Fitter apprentices indicated 
that the ittSis covered by c the rating scale were directly related .to important . 
aspects of job related training, r . r 

X - Quantity: An apprentice must meet standards of accomplishment in fearning 
the skills and knowledge required in .the training program, 

B - Quality: An apprefrtice must perform written assignments and examinations- 
carefully and completely and demonstrate the ability to meet exacting 
specifications *in performing practical manipulative exercisfes, . ? 

"^Quickness in learning instructional units: An apprentice mist demonstrate 
the ability to grasp important concepts and learn manipulative skills quickly 
<SP b e successful in job related training, 

D - Skill in use of equipment; An apprentice must demonstrate knowledge and 
skill in making s^fe, proper and efficient use of equipment in job related 
training* ' - > 

E - Variety of duties performed efficiently An apprentice must acquire a wide 
> variety of knowledge and skills to complete successfully formal job related 
* j training, ■ 

F - General .performance: Successful completion of the formal training phase of 
the Plumber/Pip^ Fitter apprenticeship involves a combination of the above 
aspects of learning ability. ^ 

Reliability of instructors' ratings is unknown because only one rating was 
obtained for each of the* five courses. Course work outlines were standard 
throughout the nation, having been coordinated through the National JATC- The 
actual range for the total sample is 44-144- The mean is 102,7 with a standard 
deviation'of 17-5. The relationship between the related training criterion and 
age and education is shown in Table 1. 

The correlation between the combined supervisory ratings ajid the sum of the five 
instructor ratings is .44. Each of the two criteria is designed to measure a 
separate aspect of apprentice performance, There is reason to believe that the 
two criteria do, to some extent* measure different aspects of performance, The 
fact that differential measurement is indicated and each criterion correlates 4 
significantly with most GATB aptitudes justifies use of a multiple -hurdle 
criterion." * 

For the purpose eff the analysis, the Criterion distribution was dichotomized so 

as to include, as nearly as possible, one-third in the low criterion group and " \ 

two-thirds in the high. This procedure is standard foi SATB studies. 



Because a multiple-hurcilc was designated for the study, analysts were required 
to determine appropriate cutting scores forythe separate job -performance and 
course-work criteria, A cutting score of 36 for the job performance criterion 
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together with 88\for the course wort criterion placed 33% of the total group, 
26? of the nonminority group, and 63% of the Blacks in the lew criterion group, 

Criterion for Cross-validation Study 

The criterion for the cros s -val idat ion* sample consisted of broad category 
ratings based on a combination of job performance and school achievement, These 
ratings were made by thp Area Joint Committee of Plumbers and Pipe Fitters and 
"school- coordinators. For. computational purposes, the ratings were converted to 
quantitative values of 61, 50,, and 39 for 'the above average, average and below 
average grqups respectively, The relationship between the criterion and age/ 
education and experience is shown in Table la,* 



* .TABLE 1 

■ Means, ''standard Deviations (SD), an,d Pearson 
Product -Moment Correlations with 
Instructor Ratings ( r l) and Supervisor Ratings ( r 2) 
for Age and Education 

Validation Sairple 
N=253 



Age (years) 
Education (years) 



Mean 

21.66 
12.35 



**Significant at the .01 level 



' SD 

5.08 
•0,92 



TABLE la 



n 

6,18** 
0.25** 



- 12 

-.014 
0,18** 



Cross-Validation Sample 
N=322 



Age (years) 

Education (years) ' 1 
Experience (months) 

*Significant at the ,05 level 
**Significant at the ,01 level 



Mean 

23,1 
11,1 
31,9 



SD 

4.3' 
1.8 
16,6 



-.059 

'.315** 

,118* 
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ANALYSIS 

The initial step in analysis is to identify those aptitudes which show some 
evidence of validity -find job relatedness. This evidence can be: / 

1. Statistical* evidence of the correlation with the criterion (r)* • 

* * ^ 

2: - Content validity's evidenced by a rating of , "critical" based on t * 
job analysis, or 

-3* Any combination of the following: . , 

--high mean 

--low standard deviation (3D) m N * - - 

--rating of H important M based on job analysis 
--demonstrated validity in a prior validation study* * 
^Statistical^ results for the validation sample ai*e shown in Table 2, 



TABLfe 2 



.Statistical Results for Validation .Sample 
N=2S3 . * 



Aptitude 



Mean 


' 3> 


H 


11 


102.1 


16.2 v 


.54** 


1 

- 20** 


96.9 


13.'2 


.48** 


.23** 


.100.1 


16.4 * 


.51** 


.20*-* 


110. 2 


18.5 


.32** 


.08 


112.8 * * 


18.9 


.25** 


. . 20** 


112k2 


1,4.0 * 


. 39** ' 


.13* 


»102.4 


16.1 : 


.29** 


.13* 


100.7 


• 19.5 


.24** 


.14* 


113.9 


20.7 


.23** 


.11 



G - General- Learning Ability 

V - Vferbal Ability 

N - Numerical Aptitude 

S r Spatial Aptitude 

P - Form Perception , x , - 

Q - Clerical Perception 
K' Motor Coordination . 

F - Finger Dexterity 

M - Manual Dexterity 

^Significant at* *he ,05 level 
^Significant at the .01 level 

Tafsle 3 summarizes the qualitative analysis.'and statistical results shown in 
Table 2 2nd shows the aptitudes considered for inclusion in the'SATB, 
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:j . ' table/-' ' • . — ' . . 

!' Surranary of Qualiitatiy/ and Quantitative Data 
fbi/ Validation Sample 





* ■ , Aptitudes 


Type of Evidence, /. i 


GVNSPQKFM 


. V i 

flpb Analysis Ratings ■ f 
Critical ' * : 
Important v " / 

, Irrelevant 


. X XXX X 


Statistical Evidence ■ 
High Mean * 
* • Low SD 
♦-^^Significant r 

Instructor Rating Criterion 
Supervisor Rating Criterion 


XX X 
'X » X 

* * * 

x, .xxx xxx xx' 

■ X X X' X .X X X 


Aptitudes Considered for 
Inclusion in the Battery 


w 

t 

'X.XXXXXXXX 



The information in Table 3 indicates that all nine aptitudes should be considered 
for inclusion in the battery, The objective is to^ develop a battery of 2, 3, or. 
4 aptitudes with cutting spores at the point (a) where about the same percent will 
meet the cutting scores as the percent placed in the high criterion group and.(b) 
which will maximize the relationship between the battery and the criterion* 

The cutting scores are set at approximately one standard deviation below the mean 
aptitude scores of the sample with deviations at five point intervals above and 
below these points to achieve the objectives indicated above. 



The following^battery resulted: 

Aptitudes 

V - Verbal Aptitude 
P - Form Perception 
M - Manual Dexterity 



Cutting Scores 

90 
95 
85 



Although Aptitude V does nqt appear in the qualitative analysis, it is not 
contraindicated on the basis of the job description* Tasks requiring reading 
ability, e.g., reading of building codes, specifications, and safety codes 
are clearly stated in the job description. ■ 

The inclusion of Aptitudes V and M is amply justified by both qualitative and 
quantitative evidence. 

VALIDITY OF THE BATTERY " . 

Initially, this section of *the report presents evidence Of criterion-related 
validity of the SATB on the validation sample, all relevant subsamples and 
Qross -validation sbmjfle, Next, it provides information on effectiveness and 
faiiness of thetest norms. Another short presentation deals<with tTie question 
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pf whether prior batteries cross-validate on the validation sample. Finally, 
this section discusses incorporating the occupation into the jOccupational 
Aptitude Pattern (GAP) structure. 

^Criterion Belated Validity • * , - 

Table 4 shows that there is a significant relationship between the job performance 

-criteria and the current SATB for (a) ,the validation sample in-aggregate* (b) 
identifiable ethnic subgroups^of the validation s&mple, and (c) the dross- 
Validatipn sample. t * ■ 



TABLE 4 
Validity of Battery 



ft 



4 \> 




• HSgh Criterion' 
' Group . 


Low' Criterion 
Group ^ 




Signifi- 




Sample 

V* 


N 


Below 
Cutting 
Scores 


Meeting 
, Cutting 
Scores 


Below 
Cutting 
Scores 


Meeting 
Cutting 
' Scores 


.Chi 
Square 


cance 
level 
P/2< 


Phi 
Coeffi- 
cient 


■' '\ 

Validation 
Total 


253 
# 


\ 

* 39 


' 130 


52 


" 52 


36,7 


\ .0005 


,38 


Black t 


46 


6. 


11 


19 


" . 10 


2,8 


. ,05 




N^n- 

mincfrity 


# 

184- 


29 


108 


28 


• 19 
71 


'24,1 

, V. 

11,3 


,0005 


" .36 ' 


Cross - 
validation* 


322 


1-02^ 

• 


-115 , " 


. 34 


-0005 


.19 



As a further check of battery validity, a multiple correlation coefficient for 
the totfal- validation sample was computed*. An R of .33. (significant at ,the ,00S 
level) was obtained between the dichotomized multiple- hurdle criterion and SATB 
Aptitudes V, P, and M- * ^ 

Effectiveness of the Battery - _ 

The level of validity shown yf Table 4 indicates that the SATBl^li be useful in 
selection. In the total val^t^ori sample, 67% were considered to be highly 
.proficient, Of those who.met the cutting scores, 80% were judged to be highly 
proficient, an increase of 13 percentage points over the existing selection 
method. Similar results were found for the cross-validation sample. -These 
findings, are shown in T^ble S. j L 
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■ TABLE 5 

* * 

Effectiveness o£ the Battery 



I 



s — 

Selection 
- System 


Number. 
Selected 


» 

Highly Proficient 
(High criterion 
-group) 


Marginal 
. • (Low criterion 
, group) 




< 


N 


%> of 
Total 


N 


% of 
Total 


Validation Sample 
. Without, Tests 
With Tests 


253 
162 


169 
130 


> 

» ■ 

* 67% 
80% 


84 
32 


» 

33% 
20% 


Cross -validation Sample 
Without Tests 
With Tests 


322 
149 


217 
115 


67% 
77% 


105 
34 


* 

33% 

■ 23% . 















Subgroup Analysis 

No difference ^n the validities for Blacks and nonminorities was found for this 
battery; the difference between the phi coefficients for Blacks and nonminorities 
is, not statistically significant (CR=-0,75h % * 



The battery is, fair to Blacks since the percent of both Blacks and nonminorities 
I who met the cutting scores approximated the percent Who were in the high criterion 
group; 46% of the Blacks met the cutting scores and 371 were in the high criterion 
group; 69% of the nonminorities met the cutting scores and 74% were in the high 
'criterion group* . v 

Prior Batteries ' ' ' 

Cross -validity of prior test norms on the validation sample was checked* The most , 
recent battery (S-61R), last validated in* 1970, is N-85, S-80, Q-75, M-80* This 
battery cross-validates with th^total validation satole. The old battery (B-304) 
validated in 1953-54, is G-85, N-80, S-80, M-80. This battery also cross -validates 
with the total validation sample. 

Occupational Aptitude Pattern * 

This ©equation was incorporated into-QAP-36 in Section II of the lM70edition 
of the Manual for the USES General Aptitude Test Battery with a double asterisk 
(**), because (1) the battery included two of the three aptitudes in the OAP, 
(2) the cutting scores of the two aptitudes are within ten points of the 
corresponding aptitudes in the QAP, and (3) a significant phi coefficient of ,24 
(P/2 < ,0005) was jobtained for this sample between the criterion and the GAP- 36 
cutting scores of N-85, P-95, and M-90* - ^ 



\ 



9 

ERIC 
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APPENDIX 1 



Descriptive Statistics for Black and 
Nonminority Subgroups of Validation Sample 



Variable^ 

Aptitude G 
Aptitude, V 
Aptitude N 
Aptitude S 
Aptitude P 
Aptitude Q ' 
Aptitude K 
Aptitude F 
Aptitude M . 
Criterion I* 
Criterion II 
'Age 

Education* 



.Mean 

105.1 
98.7 
102.7 
.111.5 
115.0 
113.6 
102.7 
101.6 
114.8 
105.9 
40.7 
21.4 
1-2 .'4 



Nqnminorily 
(N=184) 

sd 

■ ■ 15,5 
13.3 
. 15.8 

17.7 ' 

18.2 
14.4 
16.2 
. 19.1 
20.7 
16.4. 
- 6.2 
3.1 , 
0.9 



Range 

01-157 * 

66-141 

57-143 

65-1*63 

7SU67/ 

79-165 

66<t49 

53-180 

64-165- 

53-144 

18-58 ■ 

,17-34 . 

10-16 



Mean / 



89 y . 
' 89.2 

/to. 8 

101.5 

10Q.9 
. 105.6 

100.4 
95-. 2 

108.6 
'89-, 9 
35.8 
22.5 
12.1 



7 



Black 
(N?46)" 

SD 

11.9.* 
10.2 
14.1 * 
19.9 
17.1 . 
11.2 
15.9 
19.3 . 
17.3 
15*. 2 
5.6 

2.8 - 

0.8 '-"*' 



Range 

56-113 
68-119 
.48-Ul 
61-143 
49-133 
84-128 
56-130 
'44-133 
65-142 
44-119 
22-47. 
18-29 
8-15' 



f 



r 

er|c 



/ 



V > 
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APPENDIX 2 



U.I. DIUDTHIMT Or LKtON • MA H»W«H AOMtNIITn ATtON 



DESCRIPTIVE RATING SCALE 



SCORE. 



BATING SCALE FOR , 
I ■ 



O.O.Y. Title and Code 



Directions: Please read the "Suggestions to Raters" and thenTiU in the Uerpi which follow. In making yout - 
ratings, only one box should be checked for each question. * * , - 

SUGGESTIONS TO RATERS 

We are asking you to rate the job performance of the people who wotk for you, Jhise ratfrgt will serve is 
a "yardstick* against which we can compare the test scores in this study. The tilings must give i true picture 
of each worker or this study will have ve^ry little value. Vou should try u> give the most accurate ratings 
pottblefor each worket. * ■ * 

These ratings are strictly confidential and won't affect your workers in any way, Neijhet the ratings nor * 
-test scores ofony workers will be showrTto anybody in your company- We are interested only in ^testing « 
the tests/ 1 Raiings are needed only for Jhose. workers who are in the te~st»study\ 

- * *~ ' ' . 

Workers wholhavtf not completed their training period » ot who have not been on the job ot undet your 
supervision Jong enough for you to know how well they can perform this work should not be rated. 
Please inform the test technician about this if you are asked to rate any such workers. - c 
i ' * ^ fc * ' 

/Complete the last question only if the worker ts no longer en the job. ' t 

In making ratings don't let general impressions or some Outstanding trail affect your judgment. Try to h 
forget -your personal feelings about the worker. Rate only on the work performed. Here are some more 
points whicbjrnight f help you: V ** 

1. Please read all directions and the rating scale, thoroughly before rating, 

2. Fot etch question compaie your workers with 'Vorkers-in-generaT fh this job. ' That is, compare your 
workers with other workers on this job that you have known. This is very important in small plants 
where there are only a few workers. We want the ratings to be. based on the same standatd in all the plants. 

3. A suggested method is to> rate Jl workers on one question at a time. The questions ask about different 

t abilities of the worlcers v A worker may.be good in-ert c -ab ili t y ■ and -poofn n-another^-fo r example, a very 
slow worker may be accurate. So rate all workers on the first question, then rate all workers on the second 
question, and so on. - 

4. Practice 'and experience usually improve a wotkei's skill. However* on; worker with six months* experience 
4 nicy be a better worker than another with six years' experience. Don't rate one worket as poorer than 

another merely because of a lesser amount of experience. 

5. Rate the workers according to the work the/have done over a pe+iott of several weeks ot months. Dont 
rate just orr L**e bam of one "good" day, or one "bad * day or some single incident. Think in terms of 
each worker s usual or typical performance. « ' * 

$. Rate only the abilities listed on the rating sheet. Do not let factors such as cooperstiveness, ability to 
get along with others* promptness and honesty influence your-ratings. Although these aspects of a worker 
are important, they are of no value for this study as a "yardstick" against which to compare aptitude 

* test scores. * t 1 

MA ?<46 



9 

ERLC 



16 



NAUC OP WOftKCft UMnt) 



SCXt J**t-E_ 



Company Job Title: 



How often do you let this worker 
in a work situation? * ^ 

□ All the time. 

□ Several timet a day. < 

□ Several timet a week.' J 

□ Seldom. 



□ 
□ 
□ 
□ 
□ 



□ 
□ 
□ 
□ 
□ 



How Jong have you worked with thit worker? 

»- * 
G Under one month* 

C^J One to two months. 

□ three to five months* 

□ Six months or mere. 



How much can this worker, tjet done? (Worked* ability to make efficient use of time and to work at high speed.) 
(If it is possible to rate only the quantity of work which a person can do on this job as adequate or inadequate, 
use #2 to indicate "inadequate" and #4 to indicate ^adequate. **) * " * 

J . Capable of very low work output. On perform only at an unsatisfactory pace. 

2. Capable of low work output. Can perform at aslow pace. 

3. Capable of fair work output* Can perform at an acceptable- pace. ' J> 

4. Capable of high work Output. Can perform at a fast pace* 

5. Capable' of very high work output. Can perform at an unusually fast pace. 



B. How good it the quality of work? (Worker 4 * ability to do higfrgade work which meet! quality atandardi.) 



/ ^ 

J. ferformar is inferior and almost never meets minimum quality standards. 
'2. Performance is usually acceptable but tomewhat inferior in quality. 

3. Performance it acceptable but usually not superior in quality. 

4. Performance is usually tuperior in quality. 

5. Performance is almost always of the highest quality, $ 



C. , How accurate is the work? (Worker s ability to avoid making miitakei*) 

G 1. Makri very many mjjfakei. Woik n&ds constant checking. s 

□ 2. Makei frequent 'miitalws^Wttrketfe^K^ffore checking than is deiirabfe. 
G 3.*Make$ mil takes occasionally. Work needs only normal checking. 

□ 4. Makei few mistak't. Work seldom needs checking. 

O- 5, Rarely makei a mistake. Work^moit never needs checking. 



MA 744 
Apf * 1*73 



D. «How much does the worker know about the job? (Worker's understanding of the principles, equipment/ rftateriaTs 
and methods that have to do directly or indirectly with the work.) % 



G 1. Has very limited knowledge. Does not know, enough to do the job adequately. 

*Q 2. Has little knowledge. Knows enough to get by. * . ^ 

G 3. Has moderate amount of knowledge. Knows enough to do fair work. 

Q 4. Has broad knowledge. Knows enough to do good work. 

O $• Has complete knowledge. Knows thejob thoroughly. r 



E, How large * variety of job dudes can the wotjcer perform efficiently??, (Worker's ability to handle several different 
operations.) > K % 

G I. Cannot perform different operations adequately. * t **** ? 

G % Can perform aJlmlted number of different operations efficiently. 
G 3. Can perform several different operations with reasonable efficiency, 

G 4< Can perform many different operations efficiently. * 
G 5. Can perform an unusually large variety of different operations efficiently, 

F. ' Considering ill the factois already rated, antfonly these factors, how good 1 is this worker? (Worker's all-around 

ability to do the job.) * J 



O s I. Performance usually not acceptable. 

f j 

G 1 ^Performance somewhat inferior. 
O* 3, A fairly proficient worker. 

G 4. Performance usually superior, * 
O 5. An unusually competent, worker. ^ 

■ ' . '{ ' ' - *\ •* 

Complete the follow infctJNLY if the worker is noJoiiger on thejob. 

G. What do you think is the reason this person left the job? {It is not necessary to show the official reason if you 
feel that there is another reason, as this form will not be shown to anybody irj the company,) 

G I . Fired because of inability to do the job. 

O * \2. Quit, and l^eel'that it was because of difficulty doing the job. ^ * * 

O ^3* Ffted or laid off for reasons other than ability to do thejob (i.e., absenteeism, reduction in force). „ 

G 4. Quit, and I feel the reason for quitting was nqt, related to ability to do thejob. 

G 5. Quit of was^piomoted or reassigned because the Worker had learned the job well and wanted to advance. 



kkTtb «Y 



DATE 



TITLE 



COMPANY OR ORGANIZATION 



G>0 M*.7l« 



LOCATIO 4 {City, Siait, ZtP Cod*) 



FMA r*6 

t Apt. ma. 



* 'APPENDIX 3 
DESCRIPTIVE RATING SCALE FOR APPRENTICES 



Rating Scalje For 



APP 

Score 



B.O.T. Title and Code 



( 



Directions: 1 Please read the Suggestions to Raters' 1 and then fill in the items . 
which follow** In making your ratings, only one box' should be checked for each . 
question, s ♦ 

SUGGESTIONS TO RATERS 

We are asking you rate t he job performance of the apprentices whom you 
instructed, Thesd^fat ings^ will serve as a '^yardstick" against which. ria can 
compare the test^ioreif in this study* The ratings, must give a true-picture 1 
of eacK apprenticaldr this study will Jhave very little value.- You should strive 
to give the most accurate ratings possible for each"" apprentice, . ^ 

These- ratings are strictly confidential and won r t affect .your apprentices in 
any way. Neither the ratings nor test scores, of any apprentice will be shown 
to anyone other* than personnel conducting the study* We arejinterested in only 
"testing the tests, 11 Ratings aj:e needed for only those apprentices who are in- 
ythe test study* * . - * : * 

Please inform the individual who has given*you this form to complete if you h?ve 
not instijicted any of the apprentices long enotfgh for you to know how/ well they 
are jterforming, c * Such apprentices should not be rated**> , + ' 

Complete the last question on thi^-^form only if the apprentice did ndt complete * 
the training* 4 * 

V , ■ ' t- . * . . 

In making rating?, don't let ^general impressions or some outstanding traft affect 
your judgment* Try *to forget yoitf personal feeling about the apprentice* Rate 
. the person only on his performance* > Here are some additional points >hich might 
help, you: : . * ■ 

1, Please read and study all directions and the rating scale* thoroughly 5 before 
.rating an apprentice* ^ 

( -\* . . 

•2* For each question compare your apprentices with "apprentices in general 1 ' for 
this t)?pe of training* We Want the ratings to be based *on the 'same standards 
in all training courses -covering the Same occupation. ' 

3, A Suggested method is to ratfe all apprentices on one question ait a time* 
The questions pertain .to the different abilities of the apprentices. An 
apprentice may be gpod in one ability and poor in another;. for example, * 
sQvery slow apprentice may be very accurate. So rate all apprentices on 
the first qiiestion, then rate all apprentice? on the "second question^ and 
soon. 



4, Rate the apprentices accoraing to the work they have done thrpughout the* 
entire training* Don't rate just on thg basis of fcne n good M daj% one Tt bad" 
day or some single incident* think in terms of each apprentice's usual or 
typical day by day performance* 

5* Rate only on the abilities listed on the rating sheet* Do not let factors 
suc£ as cboperativjsness, ability to get along with others, promptness and 
honesty influence your ratings* Although these aspects of ah apprentice 
%are important, they are of ho v&lue for this study as a "yardstick 1 * against 
Which to conpare aptitude test scores. 
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Hgw.much ability does the apprentice have' fqr maintaining adequate \ 
producti0H in thfe vocational activity for which training w£s giyteiu \ 
(If if 'is possible to rate, only the quantity of workVhich an apprentice 
can dd v as adequate or inadequate > use #2 to indicate "inadequate 11 and #4* 
to indicate "adequate J 1 , % ~<T \ 



1* Capable of very low work output v perfomuaaiy at an 
, unsatisfactory pace* % \ + * 



r 



2 + Capable of low work output* Can, perform at a slow frace. 
3* Capable of fair work- output. Can-perform .at, an acceptable pace* 



; * 4 + Capable of high work outptit, *Can perfoim at*a f^st pace* + \ 

■ \( * ^ " ' ;/ ^ 

- j~J 5 + Capable of very high work output. Can perfqtm*at an unusually 
— fast pace, +> * 

Q V ' * ' * ^ 

B, How good was the quality of the apprentice's work during the vocational 
training? . v , * - V s 

- V i 1* Performance was inferior and almost never met minimum quality. 



2 + Performance was Usually acceptable but soniewhat ^inferior sj,n + * 

i 3 ++ Performafice was a^peptable .'but usually not superior^ quality, 

+ ^ 

^ [ 4, Performance was usually superior in quality* . * 
* 

' ; . 5 + Performance 'was almost always of "the highest quality. ♦ -> " 
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How quickly did th§ apprentice learn tha instructional units of the 
vocational training? 

Jl, * Learned the work very slowly, fteeded careful and repeated 
instructions* ^ 

4 ' m 





i. 


1 — ! 


* 


□ 


3. 


P 


4. 


n 





4, Learned most of the worK quickly* * * 

«. " 

/ 

Learned all of the work rapidly* Needed only the minmum s 
Df training or instructions for even the difficult aspects. 



How well did the apprentice use the equipment in training? 



• l] 


L. 




2. 




3. 


□ 


4. 


* | w " " i 


5. 



* f 
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How large\ a variety of job duties can the apprentice perform efficiently? 

j 1 1. Cannot perform different operations adequately. 

Can perform a 1 
efficiently. 



| | 2. Can perform a limited number of different operations 



3. Can perform several different operations witfr reasonable 



itions with, reasonable 

efficiency. * \ 

| | 4. Can perform many different operations efficiently. 

□ 5. -Can perform an unusually large variety of different operations- 
efficiently. ' m \ * 



Considering all theufactors already rated, arid OtyLy these factors, how 
acceptatyLe was the^agprentice's performance during training? 

I ! 1. Performance was unsatisfactory. * 



| ^ ' 2. Performance was not completely satisfactdiy. 

i j 3. Performance was satisfactory. . 

4. , Performance w^"s good v 



u 



5. Performance was outstanding. 
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Complete fche last question , only if 'the apprentice did not complete the training, 

V 

G, What do you think is the reasqn this person^left the training? (It. is not 
necessary to show the official reason if you. feel there is another reason, 
as- this form will not be shown to anyone "except thfe personnel cdfodufcting 
the research,) * * ■ * 

.v : 

□1- The apprentice left or was asked to leave because of inability 
■ *■ to do the course work. \ , * 

* > " ■. * '<"* 

2. The apprentice left and'l feel it was because he could notrdo. 
' — ' the courfte work,* - ^ 

-i 

3, The apprentice left or. was asked to leave for reasons other 

' — 1 * than the inability to do the coursfe woYk. * (Absenteeism, personal 
or family^ problems, etc^^y * , • 

|" | 4, The apprentice left to take advantage^pf a better opportunity. 



V 
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APPENDIX 4 " , 

* - * 

JOB DESCRIPTION ° * . 



Plunder (const 0 862-<381-030 .* l " * - 

Pipe, Fitter (const/)^ 862.381-018 .* * , 

Job Sumnary: « , * * . " » - 

Lays out/ fabricates, assembles, instalfs, alters, repairs and maintains all t 
piping, fittings, valves \ controls, fixtures, appliances, accessories, appur- 
tenances, hang^s, and supports for piping system such as those fr systems used 
*£or energy conversion and power generating facilities, heating ^ cooling-, ^refrig- 
erating, potable wat^r supply, storm drainage, sanitary artd industrial drainage, . d 
-industrial production, environmental control, or any other piping system v which ' 
^canyeys any fluid r liquid, vapor, gas, pulveyized solid, or vacuum ijsed in 3ny * . 
^Jomesti'c, commercial, industrial," institutional dr governmental installation** 
N Ins talis ^alj, pipiii^ systems according to governmental requirements, local codes, 
and job specification? based on a study of building plans and working drawing. 

■ * *t , ^ 

Work Performed: 1 i v 



Reads and interprets blueprints, building plans, job specifications 1 and local 
codes to determine tools, materials and equipment needed fo accomplish the* job 
and to determine the pipe, systeih location. * * 

Locates and marks position" of pipes, fittings, valves,,* controls, fixtures^ ' 

* appliances, accessories, appurtfenances , hangers, and supports and any Holes -or 
channels*necessary*to accommodate the above wrtH the use bf steel tape, rule, 
level, plumb bob, building- level transit and lasef -bekm* 

*Cuts openings -in walls, floors, and ceilings to acconsno^te piping systems usijjg 
hand, power and power -actuated tools* " 

*Cuts pipe of all metallic antt nonmetallic materials us^ng hand and power 
operated cutters, cutting torch or hammer and chisel. ^ . , 

Bends pipe by hand or with mechanically, electrically, *or hydraulically operated 
benjiing eqtXkmvent* ' . * 

♦Fabricates and installs £11 piping including, but not limited to, brass, copper, 
lead, steel > glass, plastics, fiberglass*, bituminous fibeif, tile, ceranutes, 
concrete and clay* ■ ' 

* Joins all of the above piping by means of threaded, calked, wiped, soldered, 
brazed, Velded, fused, mechanical, glued, cemented, or chemically bonded joints* 

♦Installs drains; vents, supplies, circulators, balancers and roof flashings* 
Selects all^traps "and related connections for .sanitary water supply and drainage* 

*&stel^L^all traps and related connections for Sanitary water supply anfc, drainage* 
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1 

, Installs energy conversion^and power generating facilities, heating, air 
^conditioning, cooling and refrigeration systems including compressors, pumps, . 
^ meters, controls, mechanical equipment, pipe, pipe supports and pipe fittings. 

, *Extends and connects pipe lines, to designated fixtures, appliafSes and mechanical 
■ equipment* 

Fills piping system with water, air or" appropriate gas or liquid for testing 
purposes in designated location for specific use* 

*Repairs, replaces, alters; and maintains all piping, fixtures, appliances, - 
accessories, and mechanical equdpnlent in the abov£ systems by using hand, pcwer 
and hydraulically operated' tools. * * 

*Per£6ims all of the above ytoi% in a safe msnner as determined by the Occupational 
Safety and Health Act of 1970* — - — 



^Critical Job Duties* These job duties were designated as critical job duties 
* because they must be performed competently if the job is to be performed in a 

satisfactory mannet, Plumber/Pipe Fitter apprentices spend about 90% of their 

working time performing these duties* ; 



f 
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* . ' APPENDIX 5 

' 'I ' ^ • ' , ^ 

First Year Curriculum for Plujnfc>er/Pipe Fitter. Apprentices, - - - 

S 

■ * 

' Safety ■* " > ' * 

x 

1* /Accident Prevention I - Developing the safe working attitude, (Ops test) 

t- x 1 "* m * 

2* Accident Prevention II.- Defining and recognizing unsafe working ' 
practices and conditions* (One test) ^ 

Mathematics ^* y 

" * > * - 

1* Mathematics I - A 'review of basic math processes* (One test) 1 

2. Mathematics II - The formulas, tables, and graphs used to solve problems 

encountered V the craftsman in his work* (One test) 
■ - * 

3* Mathematics III - The application of basic math principles to pipe 

* measurements and simple layout* (One test) 

Drawing Interpratation - * 

1. Drawing I Interpretation of technical (3 view) drawings as they relate 
to general piping, fixtures, and appliances* (One 'test) 

2, Drawing II ■* Interpretation of piping isometric drawings T and their use 
in piping "design and layout* (One test) 

3* Drawing III - Interpretation of building plans and their use in locating 
piping and piping systems within the building* (One test) 

Us e and Care of Tools : * 

'Safety procedures and, proper; uses of hand and power operated pipink tools 
an$i equipment. (Two tests J 

Soldering and, Brazing 

1* Safety procedures and preparation of tools, material, tod equipment for 
N^he soldering and brazing of nonferrous pipe joints* rane.test) 

2, Soldering, brazing, and testing of nonferrous pipe jointf* (One 'test) 

Oxyacetylene Cutting and Welding * ' r 

1* Safqity procedures and preparation of tools, material, app equipment for 
the weldirfg of flat metal and pipe* (One^test) \L 

2* Safety. procedures and^reparation of tbols, material, and equipment for 
the layout,, cutting/ asserabling^ and welding of pipe* " (One test) 



-2b- * 

\ ' ■ 

3, Safety procedures and preparation of tools, material, and equipment for 
the layout, cutting, assernbliitg, and welding of pip§ in various positions, 

> (One test) < r - 

^ v - . f« - - 

f \ 

Note: A-C are related theory courses. D-F ai?e related practical (manipula- . 
tive) courses . ' 



\ 

\ 



28 



1 w 



